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(57) A method of minimizing color aliasing artifacts 
from a color digital image having color pixels is dis- 
closed. The method includes providing luminance and 
chrominance signals from the color digital image; using 
the luminance and chrominance signals to compute 
neighborhoods of pixels which are to be processed and 
wherein such neighborhoods of pixels are substantially 
bounded by pixels defining edges; producing low fre- 
quency chrominance signals in response to the chromi- 
nance signals; using the low frequency chrominance 
signals *and the computed neighborhood of pixels to pro- 
duce noise-cleaned chrominance signals: upsampling 
the noise-cleaned chrominance signals to produce up- 
sampled noise-cleaned chrominance signals; and using 
the luminance signals and the upsampled noise- 
cleaned chrominance signals to provide a color digital 
image having reduced color aliasing artifacts. 
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Description 

[0001] The present invention relates to minimizing 
aliasing artifacts in colored digital images. 
[0002] One type of noise found in color digital camera 5 
images appears as low frequency, highly colored pat- 
terns in regions of high spatial frequency, for example, 
tweed patterns in clothing. These patterns, called color 
moire patterns or, simply, color moire, produce large, 
slowly varying colored wavy patterns In an otherwise io 
spatially busy region. Color moire patterns are also re- 
ferred to as chrominance aliasing patterns, or. simply, 
chrominance aliasing. 

[0003] There are numerous ways in the prior art for 
reducing color moire patterns in digital images. Among is 
these are numerous patents that describe color moire 
pattern reduction methods using optical blur filters in 
digital cameras to avoid aliasing induced color moire in 
the first place. However, these blur filters also blur gen- 
uine spatial detail in the image that may not be recover- 20 
able by subsequent Image processing methods. 
[0004] Some approaches deal specifically with digital 
Image processing methods for reducing or removing 
chrominance noise artifacts. One class of digital camera 
patents discloses improvements to the color filter array 25 
(CFA) interpolation operation to reduce or eliminate high 
frequency chrominance noise artifacts. Another class of 
patents teach using different pixel shapes (that is, rec- 
tangles instead of squares) and arrangements (for ex- 
ample, each row is offset by half a pixel width from the 30 
preceding row) with accompanying CFA Interpolation 
operations to reduce or eliminate chrominance noise ar- 
tifacts. However, these techniques address only high 
frequency chrominance noise, and are generally inef- 
fective against low frequency color moire. 35 
[0005] There is the well known technique in the open 
literature of taking a digital image with chrominance 
noise artifacts, converting the image to a luminance - 
chrominance space, such as CIELAB (DIE International 
Standard), blurring the chrominance channels and then 40 
converting the image back to the original color space. 
This operation Is a standard technique used to combat 
chrominance noise. One liability with this approach is 
that there is no discrimination during the blurring step 
between chrominance noise artifacts and genuine 45 
chrominance scene detail. Consequently, sharp colored 
edges in the image begin to bleed color as the blumng 
become more aggressive. Usually, the color bleed has 
become unacceptable before most of the low frequency 
color moire is removed from the image. Also, if any sub- 50 
sequent image processing is performed on the image, 
there is the possibility of amplifying the visibility of the 
color bleeding. A second liability of this approach is that 
a small, fixed blur kernel is almost required to try to con- 
tain the problem of color bleeding. However, to address 55 
low frequency color moire, large blur kernels would be 
needed to achieve the desired noise cleaning. 
[0006] It is an object of the present invention to pro- 



vide an effective method for minimizing aliasing artifacts 
in color digital images. 

[0007] This object is achieved in a method of minimiz- 
ing color aliasing artifacts from a color digital Image hav- 
ing color pixels comprising the steps of : 

(a) providing luminance and chrominance signals 
from the color digital image; 

(b) using the luminance and chrominance signals 
to compute neighborhoods of pixels which are to be 
processed and wherein such neighborhoods of pix- 
els are substantially bounded by pixels defining 
edges; 

(c) producing low frequency chrominance signals in 
response to the chrominance signals; 

(d) using the low frequency chrominance signals 
and the computed neighborhood of pixels to pro- 
duce noise-cleaned chrominance signals; 

(e) upsampling the noise-cleaned chrominance sig- 
nals to produce upsampled noise-cleaned chromi- ( 
nance signals; and 

(f) using the luminance signals and the upsampled 
noise-cleaned chrominance signals to provide a 
color digital image having reduced color aliasing ar- 
tifacts. 

[0008] It is an advantage of the present Invention that 
luminance and chrominance signals are used which not 
only reduce aliasing artifacts but also produce noise- 
cleaned chrominance signals. 
[0009] Other advantages include: 

Computation time is significantly reduced due to re- 
duced number of total computations. 
Highly aggressive noise cleaning with large effec- 
tive neighborhoods can be performed without re- 
quired large portions of the image to be resident in 
computer memory. 

Edge detail in the image is protected and preserved 

during processing. \ 

The Invention Is not sensitive to the initial color 

space representation of the image, that Is, It worics 

equally well on RGB, CMY, CMYG, or other color 

spaces used to define Images. 

FIG. 1 is block diagram which illustrates a prefen^ed 

method In accordance with the present invention; 

FIG. 2 is block diagram showing Block 14 in FIG. 1 

in more detail; 

FIG. 3 is block diagram showing Block 18 In FIG. 1 
in more detail; 

FIGS. 4a and 4b respectively depict two low fre- 
quency edge detection kernels used in Block 14 of 
FIG. 1; and 

FIG. 5 depicts as shown by the arrows directions 
that can be taken In determining neighborhood of 
pixels to be processed which are produced In Block 
14 and used In Block 1 8 of FIG. 1 . 
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[0010] Referring now to FIG, 1. Block 10 depicts the 
computation of luminance values from color digital im- 
age data which can be RGB image data. A suitable con- 
version would be: 

L = (R+2*G+B)/4 

[0011] Block 12 depicts the computations of chromi- 
nance values from RGB Image data. A suitable conver- 
sion would be: 

Gi = (-R+2*G-By4 



C2 = (-R+B)/2 

The computation of luminance and chrominance values 
( from a color digital image Is well-known to those skilled 

in the art and such computation need not be described 
further here. 

[001 2] Block 1 4 depicts the computation of neighbor- 
hoods of pixels which are to be processed and wherein 
such neighborhoods of pixels will substantially exclude 
pixels defining edges. This computation detennines tow 
frequency activity neighborhoods. Once such neighbor- 
hood is generated for each pixel location in the 3x down- 
sampled image plane, and the neighborhood is used by 
both chrominance planes. An activity neighborhood is 
represented as a multiplicity of directional activity neigh- 
borhoods (a typical number is 8). Block 14 Is further de-^ 
picted in FIG. 2 as a sequence of four steps. 
[0013] Block 16 depicts the computation of low fre- 
quency chrominances. An effective method is to tessel- 
tate each chrominance data plane with squares having 
three pixels on a side. A 3x downsampling of each 
chrominance data plane is then accomplished by re- 
placing the nine pixels in each square with a single pixel 
having, as its value, a weighted average of the nine 
chrominance values. A typical choice for the matrix of 
weights is: 

1 2 1 

242 

1 2 1 

[0014] In FIG. 1, Block 18 depicts the production of 
noise-cleaned low frequency chrominance signals In ac- 
cordance with the present invention. For each pixel in 
each of the low frequency chrominance data planes, the 
low frequency chrominance values within the low fre- 
quency activity neighborhood are combined to produce 
a noise-cleaned low frequency chrominance value. 
Block 18 is further depicted in FIG. 3 as a sequence of 
three steps. 

[0015] Block 20 depicts the upsampling of noise- 
cleaned chrominance values. Each noise-cleaned low 
frequency chrominance data plane is upsampled 3x us- 
ing bilinear interpolation. These noise-cleaned chromi- 



nance data planes and the luminance data plane from 
Block 10 all have the same dimensions. 
[0016] Block 22 (FIG. 1 ) depicts the conversion of lu- 
minance and noise-cleaned chrominances into noise- 
5 cleaned RGB image data, using the inverse of the trans- 
formations perfonmed In Block 10 and Block 12: 

R = L-C,-C2 

10 

G= L+C^ 



[0017] Referring now to FIG. 2,where Block 14 is 
shown in greater detail, Block 30 depicts the computa- 
tion of activity values. In this example, edge information 

20 is used to bourid a computed neighborhood of pixels. 
For each pixel there is an activity value that depends on 
nearby luminance and chrominance values. For each of 
the three data planes, a horizontal and vertical activity 
value is computed by taking weighted sums of data. The 

25 horizontal and vertical weight kernels are shown In 
FIGS. 4a and 4b, respectively. The absolute values of 
the resulting six values are added together and the re- 
sult is the activity value of the current pixel. It will be 
appreciated by those skilled in the art, that FIGS. 4a and 

30 4b are low frequency edge detection kernels that are 
used in Block 30 for computing activity values. 
[0018] In FIG. 2, Block 32 depicts the computation of 
low frequency activity vectors. The process begins by 
tessellating the activity value data plane with squares 

35 having three pixels on a side. For each 3x3 square, an 
activity vector is created having three components. The 
first component is the activity value found in the center 
of the 3x3 square. The second component is the second 
smallest of the nine activity values found in the 3x3 

40 square. The third component is the second largest of 
the nine activity values found in the 3x3 square. The 
three components of the low frequency activity vectors 
can be considered to be trend numbers. These trend 
numbers are used in Block 34 to determine the neigh- 

45 borhood of pixels. In this example a desired character- 
istic of the neighborhood of pixels is that they are bound- 
ed by edges. As will be explained, other image charac- 
teristics can also be used in accordance with the present 
invention to bound a neighborhood of pixels. More par- 

50 ticularly. the trend numbers are used to define the max- 
imum number of pixels in a plurality of directions from 
the pixel of interest. This results in detenmination of the 
neighborhood of pixels which includes the maximum 
number of pixels identified. This is shown in FIG. 5. 
55 [001 9] Block 34 depfcts the computation of directional 
low frequency activity neighborhoods. The depicted pre- 
ferred embodiment utilizes 8 directions as depicted in 
FIG. 5, although it is understood that a different number 
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of directions might be used instead. For any selected 
pixel, let Aq denote the first component of its activity vec- 
tor. From the selected pixel, 8 directional low frequency 
activity neighborhoods are generated as follows. Begin- 
ning at the selected pixel and proceeding in a particular s 
direction, inspect the next pixel and let A,o and A^j de- 
note the second and third components of its activity vec- 
tor, respectively. If both absolute values, ABS(Ao - A,o) 
and ABS(Ao - A^j), are less than or equal to a preset 
threshold T (for example 60 for a 1 2-bit image), then this io 
pixel is accepted as a member of the directional low fre- 
quency activity neighborhood and the process contin- 
ues with the next pixel In the same direction. 
[0020] If either absolute value exceeds T, the pixel is 
rejected and the process for that particular direction is 
stops. The process is also stopped when the neighbor- 
hood reaches a preset maximum number of members 
(for example 10 pixels). Because directional low fre- 
quency activity neighborhoods do not include the origi- 
nal selected pixel, it is possible for them to be empty. 20 
[0021] Finally. Block 36 of FIG. 2 depicts the compu- 
tation of low frequency activity neighborhoods. The se- 
lected pixel together with all of the directional low fre- 
quency activity neighborhoods comprise the low fre- 
quency activity neighborhood of the selected pixel. 25 
[0022] Block 14 is particularly suitable for use in en- 
suring that the neighborhood of pixels do not include 
edges. Neighborhood of pixels can not only be based 
upon excluding edges but also can be used so as only 
to include key colors such as flesh, sky, foliage and 3o 
grass. Moreover, the neighborhood of pixels can be 
used to include only texture and untextured regions 
such as clothing, hair and masonry work or highlights 
and shadows. Still further, other special objects of inter- 
est such as human faces, automotive vehicles and text 35 
can be used. 

[0023] Referring now to FIG. 3. Block 40 depicts the 
computation of weighted chrominance values for the di- 
rectional low frequency activity neighborhoods. For 
each direction, consider the pixels in the corresponding 40 
activity neighborhood. Each pixel has a low frequency 
chrominance value which is multiplied by a weight which 
is detennined by the pixel's position in the neighbor- 
hood. If Cjk is the kth chrominance value in the jth di- 
rectional activity neighborhood, and if Wk is the weight 
corresponding to the kth position, then Cj is the weighted 
averagechrominance value forthe jth directional activity 
neighborhood, and its value Is computed according to: 



ZCjkWkl/fzWk 
k JU J 
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[0024] A representative choice for the weights is: 



1.1 1.0 

This set of weights shows all points in the directional 
activity neighborhood getting a weigh of one except the 
most distant pixel which gets a weight of zero. It is un- 
derstood that other weight assignments are possible. 
[0025] Block 42 in FIG. 3 depicts the filtration of 
weighted chrominance values. For each chrominance 
data plane, the weighted chrominance values from 
Block 42 are sorted by size. The highest and lowest val- 
ues are discarded and the remaining chrominance val- 
ues, together with the sums of their weights, are passed 
to Block 44. If there are fewer than three non-empty di- 
rectional neighborhoods, the filtration process will pass 
no filtered chrominance values at all. The filtration proc- 
ess is done separately for each chrominance data 
plane. 

[0026] Finally, Block 44 of FIG. 3 depicts the combi- 
nation of pixel chrominances with the filtered chromi- 
nance values from Block 42. The filtered chrominance 
values are weighted by their individual sum of weights 
and combined with the selected pixel's chrominance val- 
ue with a weight of unity. The result is a noise-cleaned 
low frequency chrominance value for the selected pixel. 
This process Is done separately for both chrominance 
data planes. If there no filtered chrominance values are 
passed in from Block 42, then no change is made to the 
chrominance values at the selected pixel. 
[0027] It will be understood by one skilled in the art 
that the present invention can be used as part of a digital 
image processing chain and that it can be put in se- 
quence with other image processing steps. 



Claims 

1 . A method of minimizing color aliasing artifacts from 
a color digital Image having color pixels comprising 
the steps of: 

(a) providing luminance and chrominance sig- 
nals from the color digital image; 

(b) using the luminance and chrominance sig- 
nals to compute neighborhoods of pixels whbh 
are to be processed and wherein such neigh- 
borhoods of pixels substantially are bounded 
by pixels defining edges; 

(c) producing low frequency chrominance sig- 
nals in response to the chrominance signals; 

(d) using the low frequency chrominance sig- 
nals and the computed neighborhood of pixels 
to produce noise-cleaned chrominance sig- 
nals; 

(e) upsampllngthe noise-cleaned chrominance 
signals to produce upsampled noise-cleaned 
chrominance signals; and 

(f) using the luminance signals and the upsam- 
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pled noise-cleaned chrominance signals to pro- 
vide a color digital image having reduced color 
aliasing artifacts. 

The method of claim 1 wherein step (a) is accom- 
plished a plurality of times to produce the reduced 
resolution color digital image. 

The method of claim 1 wherein the color pixels in a 
neighborhood of pixels are selected so that color 
pixels to be averaged do not extend over and be- 
yond an adjacent edge. 

In a method for image processing, a color digital im- 
age and which includes minimizing color aliasing ar- 
tifacts from a processed color digital image com- 
prising the:steps of: 

(a) image processing a input color digital image 
to produce a new color digital image having a 
modified representation than the input color 
digital image; 

(b) reducing the number of color pixels in the 
Input color digital image or the new color digital 
image to provide at least one lower resolution 
color digital image; 

(c) converting the lower resolution color digital 
image into a space having luminance and 
chrominance content; 

(d) reducing aliasing artifacts in the chromi- 
nance content of the lower resolution color dig- 
ital image by averaging chrominance values in 
a neighborhood of a color pixel of interest, 
wherein the color pixels averaged adjacent the 
color pixel of interest is related to the distance 
from an adjacent edge in the color digital Image; 

(e) interpolating the aliasing reduced chromi- 
nance content to a higher resolution; and 

(f) using the original luminance content and the 
interpolated chrominance content to provide a 
color digital image which Is either the input color 
digital image or the new color digital image so 
that the processed digital image has minimized 
color aliasing artifacts. 

A method of computing neighborhoods of pixels 
which neighborhoods are bounded to include par- 
ticular image characteristics comprising the steps 
of: 

(a) using the digital image to compute neigh- 
borhoods of pixels which are to be processed 
and wherein such neighborhoods of pixels are 
substantially bounded by pixels defining the 
particular image characteristic; 

(b) computing an activity number for each pixel 
based upon the values of adjacent pixels; 

(c) using the acth^ity numbers for each pixel and 
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activity numbers for adjacent pixels in a prede- 
termined neighborhood to produce a plurality of 
trend numbers for each pixel related to the par- 
ticular image characteristic; and 
(d) using the trend numbers for each pixel to 
determine the neighborhoods of pixels which 
bound the particular image characteristic. 

The method of claim 5 wherein the particular image 
characteristics are edges, flesh tones, highlights 
and shadows, specific colors, texture and specific 
objects of interest. 

The method of claim 5 wherein in step (d) the trend 
numbers are used to define the number of pixels in 
a plurality of directions from the pixel of interBst. 

The method of claim 5 wherein the predetermined 
neighborhood of pixels is determined by using ker- 
nels which include weighted average numbers. 
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